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Abstract. Wc derive and study dynamical TAP equations for Ising spin glasses 
obeying both synchronous and asynchronous dynamics using a generating functional 
approach. The system can have an asymmetric coupling matrix, and the external 
fields can be time-dependent. In the synchronously updated model, the TAP equations 
take the form of self consistent equations for magnetizations at time t + 1, given the 
magnetizations at time t. In the asynchronously updated model, the TAP equations 
determine the time derivatives of the magnetizations at each time, again via self 
consistent equations, given the current values of the magnetizations. Numerical 
simulations suggest that the TAP equations become exact for large systems. 
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1. Introduction 

Within the mean field approximation, spin models with quenched disorder can be studied 
by analyzing their quenched averaged behavior or, alternatively, for a specific realization 
of the quenched disorder [1]. In the equilibrium case, the former type of analysis includes 
the replica method, while the latter one is usually formulated as naive mean field, TAP 
equations [2] , or, more generally, a Plefka expansion [3] . These equations can be derived 
by calculating the free energy in a high temperature (weak coupling) expansion, with the 
first order calculation giving the mean field free energy, the second order the TAP free 
energy and so on. For non-equilibrium and kinetic spin glass models, soft spin systems 
were the first ones to be analyzed, using the Martin-Siggie-Rose generating functional 
formalism [1]. Spin glass models with hard spins were first treated in [5l|6l[7]. A powerful 
generating functional approach was then developed by Coolen and collaborators [HI E], 
and it forms the basis of our analysis here; see also [TOj [TTj for reviews of the techniques 
used in both soft and hard spin models. However, dynamical TAP equations to describe 
the kinetics of order parameters for a specific realization of the disorder have been only 
derived for the spherical p-spin model [12] and the stationary state of the Ising spin 
model with asynchronous update dynamics |13] . 

In the same way that studying the quenched averaged kinetics of hard spin 
models usually involves a different approach compared to soft spin models, deriving 
the dynamical TAP equations for hard spin models is somewhat different from doing so 
for their soft spin counterparts. The aim of this paper is to develop a dynamical mean 
field theory that relates the dynamics of mean magnetizations, potentially time varying 
external fields, and the quenched couplings for two kinetic versions of the Sherrington- 
Kirkpatrick model, one with synchronous update, the other with asynchronous update. 
Using a generating functional approach, we derive the dynamical naive mean-field and 
TAP equations as first and second orders of a high temperature expansion, similar to 
the equilibrium case for these two kinetic models. 

In addition to the technical issues, the recent use of hard spin models with discrete 
states, e.g. Potts and Ising models [HI [151 CSl 113) iii reconstructing the connectivity 
of biological networks encourages the study of the dynamics of these models in more 
detail. Once the forward dynamics is described, it is possible to use the results to 
construct approximations at the corresponding levels for the inverse problem: finding 
the couplings, given the magnetizations and correlation functions. In this way, one 
can develop effective approximate reconstruction techniques that exploit the temporal 
structure of data and significantly improve the quality of network reconstruction in 
biological systems. In fact, the results of this paper have been recently used in two 
other recent papers on the inverse problem [181 [19] . 

The paper is organized as follows. After defining the dynamical models in the 
following section, we derive dynamical naive mean-field equations using the generating 
functional for the synchronous updated model. We report the TAP equations, for which 
the details of the derivations are reported in the Appendices. We then numerically 
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calculate the errors for these kinetic equations as a function of the strength of the 
couplings for the synchronous dynamics. 

2. Dynamical Model 

We consider a system of Ising spins Si = ±l,i = 1, - ■ ■ ,N and assume that its state 
at time t, s{t) = {si{t), . . . , SAr(t)}, follows one of the following dynamics: 

(i) Synchronous dynamics. In this case time is discretized and the probability of 
being in state s at time step t, pt{s), is given by 

Ptis) = Y^Wt[s;s']pt^^{s') (la) 

s' 

u/[. .'1 TT exp(g^g,(t - 1)) 

e,{t) = hi(t) + •£ Jijs'^it), (Ic) 

j 

This is, in other words, a Markov chain with transition probability Wt- 

(ii) Asynchronous dynamics. In this case time is continuous and, pt{s) satisfies the 
following equation 

^Pi(s) = Y^[pt{Fis)wi{FiS; t) - pt{s)wi{s; t)] (2a) 

w,{s-t) = ^[1 - Sitanh[9i{s;t)]], {2b) 

where the operator Fi acting on s flips its zth spin. 

For each of these processes one can define a generating functional. For the synchronous 
case it takes the form of 

Z[ilj,h] = (exp[J2UtMt)]y (3) 

where for any quantity A defined as a function of a path (s(T), . . . , s(0)), (■ ■ ■) indicates 
averaging over the paths taken by s(t) under the stochastic dynamics of Eqs. fllaj) - 
(fia, i.e. 



{A) = Tr Wt-MT)- s(T - 1)] ■ ■ ■ Wo[s{iy, s(0)] po(s(0)) A{s{T), s(0)), (4) 
and 

Tr-E E ■■■E- (5) 

s(T)s(T-l) s(0) 

The asynchronous case is similar expect that the sum over t in Eq. ([3]) should be replaced 



by an integration; see Appendix B 



It is useful to rewrite the generating functional by considering 6i(t) for each spin and 
each time step as a free parameter, integrate over it, and make sure that the definition 
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Eq. (ITcj) is satisfied by inserting an appropriate delta function. Tliis yields 
h]= j DO /exp \\{5{eXt) - Kit) - J2 J^,s,{t)] 



i,t I i,t 



= j D6/^/exp[z^^,(t){e,(t)-/i,(t)-^J,,s,(t)} + ^^,(t)s,(t)]\ (6) 

\ i,t j i.t I 

where DO = Ili,tdOiit) and 069 = lli,t ^dei{t)dei{t). Using Eq. @ in Eq. dS}, we get 
Z^[ip,h] = J nee Trexp[L^] (7a) 
La = J2{^eiit)[0iit) -aJ2JijSjit)] + s,it + l)e,it) - log cosh 

-ih,{t)e^{t) + ^iJi{t)si{t)}, {7b) 

where the parameter a is introduced to control the magnitude of the couplings, as will 
become clear later. 

The generating functional has the property that its derivatives with respect to ijj 
and h give the averages of the correlators involving the spins and auxiliary fields. In 
particular, defining 

^ JDOe Tr A eML.] 
JDee Trexp[Lj 

and using Eqs. ( ITal) and (l76jl . we can define mj(t) and rhi{t) as 

d log Z 

- irhi{t) = -Qf^J^ = (9a) 

= = {Si{t))^. (96) 

From Eq. ([6]), we can see that the V' limit of mi[t) is the expected value of the 
auxiliary field 9i{t) under the measure inside the integral of Eq. (|6]). It is easy to show 
that this average, similar to the soft spin case, is zero. The same limit for mi{t) gives 
us the mean magnetizations. We therefore have 

{e,{t)) = \imm,{t) = Q (10) 

(s,(t)) = limm,(t). (11) 

For a detailed discussion about these and other dynamical processes on Ising spin models 
see [H]. 

To derive the dynamical mean-field and TAP equations, one first calculates the 
Legendre transform of the logarithm of the generating functional of the process defined 
by Eqs. (11 al) - ( ITcl) . In this dynamical case, the logarithm of the generating functional 
plays the role of the Helmholtz free energy in the equilibrium statistical mechanics while 
its Legendre transform corresponds to the Gibbs free energy. One then expands this 
dynamical Gibbs free energy around the zero couplings limit, similarly to the equilibrium 
case [3] and the soft spin model [12]. In the following, we do this for Ising spins up 
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to linear order in the couplings for the synchronous update and use it to derive the 
dynamical mean-field equations. The details of how to proceed to the TAP for the 
synchronous and asynchronous dynamics are provided in the Appendices. 



3. Outline of the derivation of the dynamical equations 

The Legendre transform of the logarithm of the generating functional with respect to 
the real fields, hi, and the auxiliary fields, ipi reads 

r[m,m] = log Z[ip[rh,m], h[rh,m]] — '^'ipi[m,rn](t)rni(t) + hi[m, rn\(t)mi{t) , (12) 

i,t i,t 

where ip and h are now treated as functions of m and m through the following equalities 
dT 

g^^=-nAMit) (13a) 
dT 

^=./^am,m](t) (136) 

Eqs. ( ]13fflP and ( ]136|) together with the definition of in Eq. ( fT2l) imply Eqs. ( l9aj) 
and ( IqB . Using Eq. ([3]) in Eq. ( l7&j) . can also be written as 

r„[m,m] = log / DOO Tre^" (14a) 



= E {^Ht)mt) - « E Jv^M + ^^(t + ^Mt) - logcosh(0,(t)) (146) 

i,t j 

The idea now is that for a = the generating functional and its Legendre transform 
can be easily calculated, as the spins will be independent of each other. For the 
generating functional we have 

vr,/, _-rrf 2cosh[/^,(t-l) + V>,(t)] 

^] - l[ 2cosh(/..(t-l)) ' ^''^ 

and for the Legendre transform of log Zq we have 

Fo[m,m] = E[log(2cosh(/i°(t) + iP^{t + 1)) - log2 cosh(;t°(t)) (16) 



i,t 



where and tp^ are the real and auxiliary fields for which Eqs. (I9a|) and (j96j) are satisfied 
for given m and m at zero coupling (a = 0), i.e. 

mi{t) = tanh[/i°(t - 1) + ^^°(t)] (17a) 
- zrhiit) = tanh[/i°(t) + tlj^{t + 1)] - tanh[/i°(t)]. (176) 

This can be used to express and ip'^ in terms of m and m as 

/i°(t) = tanh-^Mi(t) (18a) 
iji{t) = tanh"^ mi{t) - tanh"^ Mi{t - 1), (186) 

where Mj(t) = mj(t + 1) + irhi{t). 
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To calculate the integral on the right hand side of Eq. f ll4ap for a = 1, we can 
expand Fq, around a = and eventually set a = 1. Using the fact that 

J Dee TtA explQa] I Dee TtA exp[La 



J Dee Trexp[fi„] J Dee Trexp[L, 

for the first derivative of Fq, with respect to a we have 
(9F„ /dn\ 



(A.) ay 



yielding 



da \da / 
da 



(19) 



(20) 



dhnt) 



(21) 



da 



(t) - mM)a + E - ^iW])- 



i,t 



da 



The last two terms in Eq. fl2T]) are zero because of Eqs. f l9aj) and fl9fe|) : hence 
9F„ 



(9a 



(22) 



The correlation function {6i{t)sj(t))a can also be easily calculated at a = yielding 



1 d^Zn 



Zodh,{t)d^j{t) 

= (tanh[/i°(t) + ^°(t + 1)] - tanh(/i°(t)]) tanh[/i°(t - 1) + '(/^°(t)], 
= —irrii{t)mj{t) (23) 

where the last equality follows from Eqs. fll7flp - fll76l) . Consequently, to first order in a, 
we have 

F„[m,m] = ^[log2cosh(/i°(t- 1) + V^°(t)) -log2cosh(/i°(t))] 



-Y.tp^{t)mi{t) +Y,^h°iit)mi{t) - iaY,Jijmi{t)mj{t) 

i,t i,t i,j,t 

which combined with Eqs. fllSap - (\18b\i gives 



F„[m,m] = - - E {log 
^ i,t 

+ ^E{iog 



1 + mi(t) 



rl - mi{t) 



1 + M,(t) 



+ {log 
+ log [ J } 



(24) 



(25) 



- ^mi(t) tanh"^[mi(t)] + ^Mi(t) tanh"^[Mi(t)] - la^, Jijrhi{t)mj{t) 

i,t i,t i,j,t 

+ 0{a^) 



Using Eq. ^M) yields 

tanh"^ Mi{t) = hi{t - 1) + ^ Jijmj{t - 1). 



(26) 
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In the hmit ip ^ for which Eq. (ITT]) is satisfied, we have 



mi{t 



tanh 



hi{t) + Y,'Jzjmj{t) 



(27) 



This is the dynamical (naive) mean-field equation for the evolution of the mean 
magnetization. The TAP equations can be derived in a similar way by expanding Fq, to 



second order in a, as shown in [Appendix A[ This yields the dynamical TAP equations 



mj(t + 1) = tanh 



(28) 



j j 
To find the time evolving magnetizations for given external field and coupling 
within the TAP approximation, the above equation should be solved self consistently 
for mj(t + 1) at each time step. Note the form of the Onsager correction (the last term 



in Eq. ([28])). The (1 



term is evaluated at time step t, but mj is evaluated at time 



step t + 1. Thus (128]) is a set of equations to be solved for mi(t + 1), not just a simple 
expression for mj(t + 1) in terms of the mj{t), as in naive mean field theory. 

The derivations of dynamical naive mean-field and TAP equations for the case of 
asynchronous dynamics defined in Eqs. ( 12 a\) and ( |2&]) are given in Appendix B As 
shown there, these equations read 



dmAt) 

mAt) H ; — = tanh 

^ ^ dt 

dmAt) 

mAt) H ; — = tanh 

dt 



hi{t) + Y,Jij'mj{t) 



K{t) + E J,,m,(t) - (m,(t) + ^) E 4(1 - ^l(^)) 



dt 



(29) 



(30) 



4. Numerical results 



To test the dynamical naive mean field (hereafter: nMF) and TAP equations (|27]) and 
(125]) . we ran simulations in which we simulated the process define by (llal) - (fTcj) for L time 
steps, for couplings drawn from a zero mean Gaussian distribution with variance g"^ /N 
{Jij is drawn independent of Jji) and subjected to two alternative types of external field. 
One was a temporally constant field with a magnitude drawn independently for each 
spin from a zero mean, unit variance Gaussian distribution. The other was a sinusoidally 
varying external field. For each sample of the Js and the fields, we generated data from 
the system for r repeats, calculated rriiit) from these repeats, and used it in (127]) and (128]) 
to predict mi{t + 1). Finally, we calculated the mean squared errors of these predicted 
values 

1 N L 

1=1 t=i 

The results for the two external fields used are shown below. 



Dynamical TAP equations for non- equilibrium Ising spin glasses 



8 



4.1. Uniform field 

Fig. [TJA. shows the dependence of the error for predicting the magnetizations at time 
t + 1, given the measured magnetizations at t. Both TAP and nMF errors increase as 
g increases, but the error of nMF is always larger than that of TAP. Furthermore, how 
close to the true (r — )■ 00) values the measured magnetizations are systematically affects 
the nMF and TAP predictions: increasing r decreases the errors for all g. This can also 
be seen in Fig. [TB, where the errors at g = 0.3 are shown as functions of r, also for two 
different values of A^. 



(A) (B) 




Figure 1. (A) The effect of magnitude of the couplings, g, on the the error of TAP 
and nMF in predicting the magnetization at t + 1 given the measured magnetizations 
at t using r runs. (B) The effect of the number of runs, r, on the error of TAP (red) 
and nMF (blue), for iV = 10 (fuU curve) and iV = 50 (dashed), and g ^ 0.3. All 
errors are averages over 25 samples of the system. The errors bars show the standard 
deviation of these samples. (C) and (D) the same as (A) and (B) but for a sinusoidal 
field. 

4.2. Sinusoidal field 

Figs. [T]C and D show the same thing as Fig.[T]A and B, but now the system is subjected 
to a sinusoidal external field with a peak amplitude of 0.1 and a period of 20 time steps. 
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The results are qualitatively the same. For this case, we also look at the time dependence 
of the errors in TAP and nMF equations. 

Fig. [2] shows the time dependent error (i.e. the right hand side of Eq. ( 13T]) without 
averaging over time) versus time. For weak coupling, the error of both nMF and TAP 
are very small. At intermediate values of g, the error of nMF is still comparable to TAP. 
but fluctuating. At yet stronger couplings, the nMF prediction very rapidly becomes 
different from the actual measured values of the magnetizations. 




10 20 30 40 50 



10 20 30 40 50 



10 20 30 40 50 



10 20 30 40 50 



Figure 2. (A) Time dependence of the nMF (blue) and TAP errors (red) together with 
an example of the measm'ed magnetization (lower panel) from 50000 repeats (black), 
nMF prediction (blue) and TAP (red) for one spin and for g = 0.1 and N = 40. (B) 
and (C) show the same thing but for g = 0.28 and g = 1.5 respectively. Note the 
difference in the scale of the y axes. 



5. Discussion 

The TAP approach, formulated as a high temperature Taylor series expansion of the 
equilibrium Gibbs free energy [3], is a powerful method for studying equilibrium spin 
glass models. Similarly, dynamical TAP equations allow analyzing the dynamics of a 
single sample of a disordered system away from equilibrium. In this paper, we derived 
these equations for Ising spin glasses with both synchronous and asynchronous updates. 
The main idea behind the derivation is similar to the one used by Biroli [12] for the 
soft p-spin model obeying a Langevin equation, with the difference that instead of a 
MSR formalism, we had to use the generating functional approach of Coolen. For the p- 
spin model the spherical condition results in the appearance of the the autocorrelation, 
{si{t)si{t')) , and response functions as order parameters in dynamical TAP. For the hard 
spin Ising model, this is not the case. The response function can, of course, be directly 
calculated from its definition and the TAP equations, but calculating correlations. 
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{si{t)sj{t')) , function requires a different approach. 

The derivation does not rely on the symmetry of the couplings and can, therefore, be 
applied to systems without detailed balance. For the stationary case, the TAP equations 
are identical to those derived for the equilibrium model with symmetric connections. 
This has been previously shown by Kappen and Spanjer [13] using an information 
geometric derivation for the stationary state of the asynchronously updated model. 
Numerical simulations with both a constant external field and a rapidly evolving one 
show that the TAP equations predict the dynamics of the individual site magnetizations 
very well. This may not be surprising given the fact that the model we studied here was 
a kinetic variant of the SK model for which the equilibrium TAP equations provide the 
exact picture. 

It is intriguing that the Onsager term in Eqs. ( !28l) and ( !30l) does not get the form 
JijJjiil — as would be expected from a simple reaction argument. This observation 
has also been made earlier by Kappen and Spanjer [13]. A naive argument showing that 
the true correction to the mean-field equations is of the type Jj^(l — rn^) is as follows. 
Starting from the exact equation 

m,{t + 1) = (tanh[/i,(t) + Ji,s,(t)]), (32) 

i 

we expand tanh around 6j(t) = hiit) + Jij''^j{t) to quadratic order in Jij^Sjit) 
where 5sj{t) = Si{t) —rriiit). The linear term vanishes, and using {[5sj{t)Y) = 1 —m'^(t) 
we have 

mi{t + l) = tanh[6i(t)] - {1 - tanh.'^ [bi{t)]) tcinh[bi{t)]{[J2 JijSsjit)]'^) 

j 

= tanh[6,(t)] - (1 - tanh" [b,{t)])mi{t + 1) E ' ^?(^)) 

j 

= tanh[/i,(t) + E J,,mj{t) - mi{t + 1) E " "^?(^))] 
i j 

where in the second line we have used the mean field equation mj(t + 1) tanh(&i). 

An important issue that we have left out in this paper is the expected number 
of solutions to the TAP equations for arbitrary couplings. It has been known for a 
long time that, at low temperature, the expected number of solutions of the TAP 
equations for the SK model with symmetric couplings is exponential in [20]. It 
is also possible to calculate the number of metastable states for couplings with an 
antisymmetric component at zero temperature [7]. The TAP equations presented here 
allow extending the calculation in [2D] to the type of couplings considered in [7] for 
non-zero temperatures. This calculation will be presented elsewhere. 

The equilibrium TAP equations, derived for spin glass models with symmetric 
couplings, can be used in deriving efficient approximations for solving the inverse 
problem of reconstructing a spin glass model from samples of its states [211 122]. As 
has been recently shown [IHllin], the dynamical equations derived here can be employed 
for taking the reconstruction to a more powerful level, allowing for the reconstruction 
of systems outside equilibrium. 
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Appendix A. TAP equations for synchronous update 



For deriving the TAP equations, we note that 



+ 



dVt 

da 



n 2\ 



'XT 

da 



n 2 



(Al) 



The first term on the right hand side of the above equation is equal to zero. To calculate 
the next two terms, we use the Maxwell equations 



.dhfit) 
da 

da 



;i.2a) 
(1.26) 



to write 
dQ _ 

We are therefore interested in calculating 



ijt 



where 



da^ 



^\da, 



6 



'dny' 

da) 



'dQ 
da 



da 



;i-4) 



a/ I a 



- i^di{t)JijSj{t) + i^59i{t)Jijmj{t) 

ijt ijt 

+ i rhi{t)Ji,j5sj{t) + i ^ mi{t)Jijm,j{t). 

ijt ijt 



;i.5) 



Defining 6sj{t) = Sj(t) — mj{t) and 66i(t) = 6i(t) — rhi(t), this can be rearranged into 
the following form: 



\ da , 



ijt 



Now it is simple to evaluate Eq. fll.4p 

2\ 



6 



dn' 

da 



) =- J2 {59,{t)Jij5sj{t)5ei,{t')Ji.j>5sj,{t'))o, 

I a ijti'j't' 

The factors have to be paired and for the pair averages we use 



-m^iit) + 2irhi{t)mi{t + 1) 



;i.6) 



(1.7) 



:i.8a) 
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1.86) 
1.8 c) 



The terms containing products of two averages of the form {595s) vanish, because one 
pair factor has to have t' = t — 1 and the other has to have t = t' — 1, which cannot be 
satisfied simuhaneously. This leaves 



1 2\ 



ijj't 

Y.[-^Kt) + 2trhi{t)m,{t + 1)]4[1 - m2(t)] 



:i.9) 



ijt 



Using this to calculate Fq, to the quadratic order in a, differentiating with respect 
to rhj(t), and setting tjij = yields the dynamical TAP equations ( 128|) . 

Appendix B. Asynchronous Dynamics 

In the asynchronous case the generating functional takes the form 

Z^li,, h]= f Deel[(exp \i f dt9,{t)[9i{t) - Kit) -aY,J,jS,{t)] + / dtilji{t)si{t)\ ) (2.1) 



and (■ ■ ■) now indicates averaging with respect to the distribution defined by the solution 
to the differential equation Eq. fl2aj) . This solution can be written as 



djji. 



n 



1 +/ii(t) 



Si{t)-l 



— = -fii + tanh6'i(t), /ii(0) = Si(0). 



(2.2a) 
{2.2b) 



The solution to Eq. (12.261) can be written as 

fii{t) = f dt' e*'-* tanh(^i(t')) + e-*/ii(0). (2.3) 

JO 

The dynamical Gibbs free energy (i.e. the Legendre transform of the log generating 
functional) is then 

r«[7fi,m] = log / DeO\lLxY> \i I dt9i{t)[9i{t) - hi{t) - a ^ J,,s,(t)] + / dti)i{t)si{t) 



+ iJ2jdt hi{t)mi{t) -J2jdt Mt)m{t) 



(2.4) 



Appendix B.l. nMF for asynchronous update 

As we did for the synchronous case, we first calculate the non-interacting {a = 0) 
generating functional 

logZo = Y. [ dt\og[cosh{ij,{t)) + /i°(t) sinh(^/;,(t))] (2.5a) 



(2.56) 



/i°(t) = f'dt' e*'-*tanh(/i°(t')) + e-*/ii(0) 
Jo 
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ro[m, m]=Y.j dt {log[cosh(V'°(t)) + sinh(V'°(t))] - ^°(t)m,(t) + ^/i°(t)m,(t)} (2.6) 

i 

where now ip'^ and are functions of m and rh from the following equations 
5 log Zo sinh[V;°(t)] + cosh[V'i(t)] 



cosh[^,(t)] + sinh[^/.,(t)] 



mi(t) (2.7a) 



5\ogZn f , , n, , X sinh['0j'(t')l . / X 



5/i,(t) 7 ' 'cosh[^/^0(t')] +/i°(t')sinh[^/'0^f)] 

and 

X°(t',t) = = e(t' - t)e-*'(l - tanh^[/^0(t)]). (2.^ 

For nMF, we need to calculate the linear term in a. This is 



-I 



5^ Jij j dt{hi{t)sj{t))^ = -^'1 J dtmi{t)mj{t) (2.9) 



where the last equality follows from 

Consequently, up to the linear term in a, we have 

T^VnM = UrnM-^o.Y.J^.jdtrnmmAt) (2.11) 

Using the fact that dTo/drhiit) = ih^{t), we find that 

ihi{t) = ih^i{t) - i ^ J^jmj{t) (2.12) 
j 

Together with the fact that for ip^ = 0, we have mj(t) = /i^(t), the mean- field equation 
is 

^.™,„.U..,MO.i:..-..Wl (2.3, 
Appendix B.2. TAP equations for asynchronous update 

To derive the TAP equations, we need to calculate the second derivative of F with 
respect to a. Similar to the synchronous update case, we have 

^ = - E J^3J^r j dtdt\5ei{t)5s,{t)59,{t')5sj,{t'))^ (2.14) 

iji'j' 

and the non-zero contributions come from pairing the terms inside the averages. 
Non-zero contributions come from {S6i{ty)a. A correlation function of the form 
{S9i(t)Ssj>{t'))a is nonzero for t' < t but since it always appears multiplied by 
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{Ssj{t)66ii{t'))a, which is zero for t' < t, it does not contribute to the final results. 
We therefore have 

a=0 



(9a ^ 



(2.15) 



- E J^jJ^^ J dt{6e,it)6s,it))o{Se,{t)6s,{t))o (2.16) 

ij 

To evaluate the above expression we first note that 

([5s,(t)no = ^^ = l-m^^(t) (2.17a) 

([^^^(^)]')o = = - / d/-^§^j,{t') + / dt'[x.{t',tMf)r (2.176) 



6h,{ty J 6h,{t) 

where the last equality follows from 6fi^{t)/6hj{t) = and 
,.o^.N _ sinh[^°(t)] 

^^^^-cosh[^0(t)] + /iO(t)sinh[^0(t)] ^ • ' 

^ ^ - tanh^[/.°(t)]]e*'-e(t' - t) 

= -2tanh[/i°(t)]x°(t',t) (2.186) 
Using Eq. fl2A8l in Eq. (12171 gives 

{[Sm]\ = -2ztanh[/i0(t)]m,(t) + J dt'[x°(t', t)7°(t')]' (2-19) 
The dynamical Gibbs free energy can then be written as 

T4m,m] = To[m,m]-^aY,J^J J rni{t)m,{t)-]-a^Y.Jij j dt{[5di{t)f)o{l-m]{t)){2.2Q) 

ij ij 

where in the last sum ([5^i(t)]^)o should be considered as a function of m and rh. 



Appendix B.2.1. Stationary case For the stationary case we have h^i{t) = hf and we 
have to take t oc. This gives 

/iJ = tanh(/if ) (2.21a) 

' 1 + /iOtanh[^/^i] ^ ■ ' 

' dt'ix'lit^tHit')]' = {-imf (2.21c/) 

Using Eqs. ([MlaD, dMH, (iMlcD yields 

m- + = tanh(/if ) (2.22) 
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Consequently, for the stationary case, Eq. fl2.19p can be written as 

{[SOi{t)]^)o = -2%m,mi + Oim"). (2.23) 

and therefore 



da'' 



a=0 



H J2 Jfjrhimi{l - m^) + 0{m'^) (2.24) 

ij 

Using this the TAP equations in the stationary case would be 



tanh ^ rrii = hi + Jij^j ~ '^ij^^ " ""^j) (2.25) 



3 3 

which is identical to the result of 



Appendix B.2.2. General case Under general conditions we cannot express h and if) 
explicitly in terms of m and m. However, we can still calculate dV / drhi{t)i at m = 0, 
which is what we need for deriving the TAP equations. 

First note that the second term on the right-hand side of Eq. fl2.19p is of quadratic 
order in ip in the limit ■?/;—)■ (from Eq. fl2.18al) ). But rh is linear in ip (from Eq. (]2.76p ). 
so this term is of second order in m and its derivative with respect to rh vanishes as 
m — )■ 0. Thus we can discard it in finding the TAP equations. 

We are now interested in the following quantity 

^^/dt'([4(t')no(l-m^(t')) = 

-2zx,(t)(l - ml{t))5,, -2tJ dt'^^^m,{t'){l - ml{t')) (2.26a) 

where Xi(t) = tanh(/i°(t)). For rhj(t) — )■ 0, The only term that will be nonzero on the 
right hand side of Eq. (I2.26ap is the first, as long 6xi{t')/6rhi{t) does not diverge as fast 
as or faster than 1/m as m — 0. Whether 6xi{t')/6rhi{t) is regular in the limit m — )■ 
or not depends on whether the functional matrix 6{m, rh) / 6{h, ip) is regular in this limit. 
The latter is not singular when the generating functional is regular unless the system is 
at a phase transition. Assuming that this is not the case, we can ignore the last term 
in Eq. ^M^- 

Now we can proceed the way we did in the naive mean-field case, but evaluating 
Fq, to second order in a. The functional derivative of Fq, with respect to rh, evaluated 
at a = 1, gives ih: 

ihiit) = i/i°(t) -i^ Jijm,(t) +2tanh[/i°(t)]^4[l -m2(t)], (2.27) 

3 3 

tanh /i°(t) can be related to yU°(t) through 

^ = -/i° + tanh/.°(t), (2.28) 
and /i^ — rui when ip and m — > 0, yielding the TAP equations 

— ^ + m,(t)= (2.29) 
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tanh 



dmi{t) 
dt 



rrii 



(2.30) 



Note that these are of the same form as those for the synchronous-update model with 
mj(t + 1) replaced by + drrii/dt. 
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